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We generalize the exact solution to the Bernoulli shift map. Under certain conditions, the gen- 
eralized functions can produce unpredictable dynamics. We use the properties of the generalized 
functions to show that certain dynamical systems can generate random dynamics. For instance, 
the chaotic Chua's circuit coupled to a circuit with a non-invertible I-V characteristic can generate 
unpredictable dynamics. In general, a nonperiodic time-series with truncated exponential behavior 
can be converted into unpredictable dynamics using non-invertible transformations. Using a new 
theoretical framework for chaos and randomness, we investigate some classes of coupled map lat- 
tices. We show that, in some cases, these systems can produce completely unpredictable dynamics. 
In a similar fashion, we explain why some wellknown spatiotemporal systems have been found to 
produce very complex dynamics in numerical simulations. We discuss real physical systems that 
can generate random dynamics. 

PACS numbers: 05.45.-a, 05.40.-a, 47.52. +j 

I. INTRODUCTION 

In the last decades, the strands of chaos theory have spread across all the sciences like a fractal tree. Chaos theory 
and nonlinear dynamics have provided new theoretical tools that allow us to understand the complex behaviors of 
many physical systems [Lorenz, 1993], [Schuster, 1995], [Jackson, 1991], [Moon, 1991], [Strogatz, 1994], [Glass, 1998]. 

Deterministic chaotic behavior often looks erratic and random like the behavior of a system perturbed by external 
noise. However, the known chaotic systems are not random: precise knowledge of the initial conditions of the system 
allows us to predict exactly the future behavior of that system, at least in the short term. 

In chaotic systems we can observe the divergence of nearby trajectories [Lorenz, 1993], [Schuster, 1995], [Jackson, 
1991], [Moon, 1991], [Strogatz, 1994], [Glass & Mackey, 1998]. This property represents a difference between complex 
behavior due to deterministic chaos and that due to true randomness [Lorenz, 1993]. 

This divergence of nearby trajectories leads to a kind of long-term unpredictability. In the random systems we 
observe immediate unpredictability. Already the next value is unpredictable. 

There are processes, as the breaking sea waves on the shore, that are deterministic although they seem random. 
The behavior of these processes is determined by precise laws. 

According to many definitions of randomness, in a random sequence of values, the next value can be any of the 
previous values with equal probability [Lorenz, 1993]. An example is the coin tossing experiments. Knowing the result 
of the last coin tossing realization does not increase our chance to guess the result of the next realization. 

According to less strict definitions, in a random sequence, the next value can be any of the possible values even if 
they possess different probabilities, and even if their probability depends on the previous values [Lorenz, 1993]. In 
other words, for the next outcome there is always more than one possible value. 

On the other hand, in a non-random sequence, the next value is always determined by the previous values [Lorenz, 
1993], [Schuster, 1995], [Jackson, 1991], [Moon, 1991], [Strogatz, 1994], [Glass & Mackey, 1998]. 

Can we explain all the randomness we observe in nature using the known temporal chaotic systems? 

Another very active area nowadays in nonlinear dynamics is spatiotemporal chaos. 

There are several paradigms and model equations for the studying of spatiotemporal and extended systems [Kaneko, 
1985], [Kaneko, 1992], [Kaneko, 1989], [Chate & Manneville, 1988], [Crutchfield & Kaneko, 1988], [Mayer-Kress & 
Kaneko, 1989], [Kuramoto, 1984], [Politi & Torcini, 1992], [Kaneko, 1990], [Hansel & Sompolinsky, 1993], [Bauer et 
at, 1993], [Bunimovich, 1995], [Grassberger & Scheiber, 1991], [Kaneko & Konishi, 1989], [Kaneko, 1990a], [Chate, 
1995], [Gonzalez et at, 1996], [Gonzalez et ai, 1998], [Guerrero et at, 1999], [Pikovsky & Kurths, 1994], [Bohr et at, 
2001], [Grigoriev, 1997], [Grigoriev & Schuster, 1998], [Shibata & Kaneko, 1998], [Wackerbauer & Showalter, 2003], 
[Willeboordse, 2003], [Kaneko & Tsuda, 2003]. 

Coupled map lattices are among the youngest models of extended dynamical systems. 
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There is a vast literature dedicated to coupled iterated maps [Kaneko, 1985], [Kaneko, 1992], [Kaneko, 1989], 
[Chate & Manneville, 1988], [Crutchfield & Kaneko, 1988], [Mayer-Kress & Kaneko, 1989], [Grigoriev & Schuster, 
1998], [Shibata & Kaneko, 1998], [Kaneko & Tsuda, 2003]. Many important numerical results have been obtained in 
this area. However, the behavior of such coupled systems is quite complex and by no means fully explored. 

Are there fundamental differences between the dynamics generated by temporal and spatiotemporal systems? 

Researchers have found [Chate, 1995] that the usual temporal chaos methods of time-series analysis are doomed 
when the dimension of the spatiotemporal system becomes large (say larger than 10). 

On the other hand, it is generally recognized [Kaneko, 1985], [Kaneko, 1992], [Kaneko, 1989], [Chate & Manneville, 
1988], [Crutchfield & Kaneko, 1988], [Mayer-Kress & Kaneko, 1989], [Kuramoto, 1984], [Politi & Torcini, 1992], 
[Kaneko, 1990], [Hansel & Sompolinsky, 1993], [Bauer et al., 1993], [Bunimovich, 1995], [Grassberger & Scheiber, 
1991], [Kaneko & Konishi, 1989], [Kaneko, 1990a], [Chate, 1995], [Gonzalez et al., 1996], [Gonzalez et al, 1998], 
[Guerrero et al, 1999], [Pikovsky & Kurths, 1994], [Bohr et al, 2001], [Grigoriev, 1997], [Grigoriev & Schuster, 1998], 
[Shibata & Kaneko, 1998], [Wackerbauer & Showalter, 2003], [Willeboordse, 2003], [Kaneko & Tsuda, 2003] that the 
dynamics of coupled maps is still far from being understood. 

Cellular automata conform another class of dynamical systems that has been studied intensively during the last 
years as simple models for spatially extended systems. In this case, one replaces the continuous variables at each 
space-time point by discrete ones [von Neumann & Burks, 1996], [Wolfram, 1983], [Wolfram, 1984], [Wolfram, 1984a], 
[Wolfram, 1986], [Hastings et al, 2003], [Israeli & Goldenfeld, 2004]. 

In spite of their simplicity, automaton models are capable of describing many features of physical processes [Wolfram, 
1983], [Wolfram, 1984], [Wolfram, 1984a], [Wolfram, 1986], [Hastings et al., 2003], [Israeli & Goldenfeld, 2004]. 

Most results in the field of spatiotemporal systems have been obtained by numerical simulations [Grigoriev & 
Schuster, 1998]. 

In the present paper we will show that there exist dynamical systems that can generate completely unpredictable 
dynamics in the sense that given any string of generated values, for the next outcome, there is always more than one 
possible value. 

The mechanism responsible for the generation of randomness, in a very general class of models and physical systems, 
is the presence of non-invertible transformations of time-series that contain (truncated) exponential dynamics or 
chaotic dynamics. 

Using a new theoretical framework for randomness we will investigate some classes of coupled map lattices. We will 
show, that in some cases, these systems can produce completely unpredictable dynamics. 

In a similar fashion, we will explain why some elementary cellular automata with very simple rules have been found 
to produce very complex dynamics in numerical simulations [Wolfram, 1986]. 

Some consequences of these results in the study of physical and economic systems are discussed. 

Some of the concepts discussed in the present paper about the differences between common chaotic and random 
systems are inspired in [Brown & Chua, 1996] and [Gonzalez et al., 2000]. 



II. UNPREDICTABLE DYNAMICS 



We will call a time-series {X n } unpredictable if for any string of m + 1 numbers Xq, X\, X2, X m (m can be as 
large as we wish), then the next number X m+ \ can take more than one value. 
Let us define the general function 

X n = P{6Tz n ), (1) 

where P (t) is a periodic function, T is the period of function P(t), 6 and z are real numbers. An important 
example of function P (t) is function P (t) = t (mod 1). Note that this is a periodic function with period T = 1: 
P(t+l) = (t + l) (modi) = P(t). 

We will show that the dynamics contained in function is unpredictable. 

Let us define the family of sequences 

X (k,m) = p [ T (0 Q + g m fc j g n] ^ (3) 

where z — p/q is a rational number such that p and q are relative primes (p > q), k and m are integers. The parameter 
k distinguishes the different sequences. For all sequences parametrized by k, the first m + 1 values are the same. This 
is true because 



x (k,m) 



T9 (p/q)" + Tkp n q^- n A - P [T0 Q (p/q) n ] , (3) 
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FIG. 1: First-return maps constructed using the dynamics produced by function for 8 = n. (a) z = 2. (b) z — 8/5. (c) 
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FIG. 2: Scheme of a system that can produce unpredictable dynamics. 



for all n < m. Note that the number kp n q (jn ™) is an integer for n < m. 
The interesting conclusion is that the next value 



X 



m+1 



T0o ip/q) 



m+1 



Tkp 
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/q 



is unpredictable. X^]^ can take q different values. For a generic real z, X m+ i can take an infinite number of values. 
Let us discuss some properties of the following particular case of function Q : 



(4) 



X n = 9z n (mod 1). 



(5) 



For z = 2, function (JSJ is the exact solution to the Bernoulli shift map. 

Figures ^a)-(c) show different examples of first-return maps produced by the dynamics represented by Eq. JSJ. 
The values generated by function JSJ) are uniformly distributed in the interval < X n < 1. 
We have generalized these results to functions of type 



X„ 



h[f(n)} 



(6) 



To produce complex dynamics, the function f{n) does not have to be exponential all the time, and function h(y) 
does not have to be periodic [Gonzalez et ai, 2002]. In fact, it is sufficient for function f(n) to be a finite nonperiodic 
oscillating function which possesses repeating intervals of truncated exponential behavior. For instance, this can be a 
common chaotic sequence. 

On the other hand, function h(y) should be non-invertible. In other words, it should have different maxima and 
minima in such a way that equation h(y) = a (for some specific interval of a, a\ < a < 0.2 ) possesses several solutions 
for y. Of course, the image of function f(n) should be in the interval where function h(y) is noninverible. 

Gonzalez et al. [2002] have shown that a chaotic Chua's circuit [Matsumoto et ai, 1985], [Matsumoto et aZ.,1987] 
coupled to a Josephson junction can generate unpredictable dynamics. In fact, in order to produce unpredictable 
dynamics we can use a system with the features shown in Fig. [21 

A method for the construction of circuits with non-invertible I — V characteristics can be found in [Chua et at, 
1987] and [Comte & Marquie, 2002]. 
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FIG. 3: First-return maps produced by dynamical system @-© for Xo 
(b) a = 7T. 



Y = Z = 0.1, Q = 200, b = c = 2. (a) o = 5/4. 



III. FINITE SYSTEMS OF COUPLED MAPS 



Let us consider the following dynamical system 



X n +1 



I aX n , if X n < Q, 
~'\bY n , ifX n >Q, 

Y n +i — cZ ni 



(7) 

(8) 



Z n +i = X n (mod 1). 



(9) 



Here a can be an irrational number, a > 1, b > 1, c > 1. We can note that for < X n < Q, the behavior of function 
Z n is exactly like that of function JSJ). For X n > Q the dynamics is re-injected to the region < X n < Q with a new 
initial condition. While X n is in the interval < X n < Q, the dynamics of Z n is unpredictable as it is function JSJ. 
Thus, the proccess of producing a new initial condition through Eq. JSJ is random. 

If the only observable is Z n , then it is impossible to predict the next values of this sequence using only the knowledge 
of the past values of {Z n }. 

An example of the dynamics produced by the dynamical system Q-© is shown in Fig. |3J 

In the dynamical system Q-© the variable Z n is quasi-random, but the variable X n is predictable because in the 
interval < X n < Q the rule to determine the next number is a one-valued function. 

In principle, we can construct dynamical systems where all the variables (taken separately) are random. 
Consider the following system: 



X 



n+l 



(a + bZ n )X n + cY n , ifA„< 
bY n , if X n > 



(10) 



Y, 



n+l 



cZ„ 



(11) 



Z n+ i = X n (mod 1) 



(12) 



Note that X n , in Eq. lO, sti11 

possesses a finite exponential behavior for < X n < Q, because (a + bZ n ) is always 
a positive number. However, in this case the dynamics of X n is influenced all the time by the random dynamics of 

Z n ■ 
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FIG. 4: Typical dynamics generated by dynamical system ()13|l - l|15| l. All the variables are unpredictable. Parameter values: 
a = 4/3, b — 2.1, c = 7.3, d = 3.1, / = 7.7, g = 113. Initial conditions: Xo = Yo = Zq = 0.1. (a) First-return map of variable 
X n . (b) The same for variable Y n . (b) The same for variable Z n . 

If we are interested in dynamical systems where all the variables are random and uniformly distributed in the 
interval [0, 1], then we can use the following one: 

X n+1 = [(a + bZ n ) X n + cY n + 0.1] (mod 1), (13) 



Y n+1 = [dZ n + fX n + 0.1] (mod 1), (14) 



Z n+1 = [gX n + 0.1] (modi). (15) 
Here X n shares many of the properties that are present in the system Q10 |l -I|12 |l . 

First-return maps of the time-series produced by dynamical system (I13(l - <|15(1 can be observed in Fig. 0] 

IV. COUPLED MAP LATTICES 

Suppose now that we are interested in symmetric equations in the sense that all equations for X n , Y n and Z n are 
equivalent. 

Note that in the dynamical systems 0-©, <|Tn|) - ((l"^jl and l(T3* |l -((T5 )l . the equation for Z n+ i is constructed in such 
a way that a nonperiodic dynamics with truncated exponential behavior is the argument of a non-invertible function 
(say y = x (mod 1)). What function is in the argument is not so important. So we can use a function that depends 
on X n , but also on Y n and Z n as well. On the other hand, the most important feature of the equation for Y n+ \ is 
that it depends on the random variable Z n . So it can also depend on X n and Y n . Thus, let us transform dynamical 
systems (I13ll - I|15t into a symmetric system: 

X n+1 = [(ai +b 1 Y n + c 1 Z n )X n + d 1 Y n + e 1 Z n ] (modi), (16) 



Y n+1 = [(a 2 + b 2 Z n + c 2 X n ) Y n + d 2 Z n + e 2 X n ] (mod 1), (17) 



Z n +i = [{a 3 + b 3 X n + c 3 Y n ) Z n + d 3 X n + e 3 Y n ] (mod 1). (18) 

Like the systems discussed before, the set of Eqs. (|16H - I|18H will produce unpredictable dynamics for all the variables 
X n , Y n and Z n taken separately. This can be seen in Figs. E2a)-(c). 
Can we construct a coupled map lattice with these characteristics? 
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FIG. 5: Dynamics produced by the set of Eqs. 111611 - 1181 . Parameter values: a\ — 1.3, b\ = 7r, ci = 2.6, di = 1.5, e\ = 1.1, 
ci2 = 4.6, 62 = 2.1, C2 = e, efe = 3.2, e2 = 7.1, 03 = 2.9, 63 = 5.4, C3 = 8.7, dz — 4.5, e3 = 1.9. Initial conditions: 
Xo = Yo — Za = 0.1. (a) First-return map of variable X n . (b) The same for variable Y n . (b) The same for variable Z n . 

(a) (b) (c) 




FIG. 6: Typical dynamics generated by the coupled map lattice defined by Eq. (1191 . Parameter values: a = 2, b = c — d — 
/ = 1. Initial condition: Xo = 0.1. (a) i — — 1. (b) i = 0. (c) i = 1. 

Now we will have a dynamical variable that depends on the time n and the space coordinate i. Instead of three 
equations with three variables as in system 1|16JI - 1|18|I . we will have an infinite number of equations. Our variable will 
be X n (i). 

An example of a coupled map lattice with all the properties discussed above is the following: 

X n+l (i) = [(a + bX n (i-l) + cX n (i + l))X n (i) + dX n (i-l) + fX n (i + l) + 0.1] (mod 1). (19) 

Note that for each space site i, we have a nonpcriodic dynamics with truncated exponential behavior that depends 
on the behavior of the space sites (i — 1) and (i + 1). This dynamics is always the argument of a noninvertible function 
(in this case y = x (mod 1)). We are sure that the dynamics is nonperiodic because even something as simple as 
X n +\(i) = aX n (i) (mod 1) would produce chaotic behavior for a > 1. 

Another interesting example of coupled map lattices with random behavior can be found in the system 

X n+1 {i) = [(a + bX n (i - 1) + cX n {i) + dX n (i - 1)) X n (i) + fX n (i - 1) + gX n (i + 1) + 0.1] (mod 1). (20) 

Here the coefficient of variable X n (i) in the argument of the modulo function depends on X n (i — 1), X n (i + 1) and 
the same X n (i). 

Figures E^a)-(c) show the dynamics generated by different sites in the introduced coupled map lattices. 
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TABLE I: Representation of Rule 30 cellular automaton. 
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TABLE II: Representation of Rule 110 cellular automaton. 



V. CELLULAR AUTOMATA 

The values of the sites in a one-dimensional cellular automaton are updated in parallel in discrete time steps 
according to a rule of the form 

Y n+1 (i) = F [Y n (i - r),Y n (i - r + 1), Y n (i + r)} . (21) 

The site values are usually taken as integers between zero and (k — 1) [Wolfram, 1983], [Wolfram, 1984], [Wolfram, 
1984a], [Wolfram, 1986]. 

Cellular automata can be considered as discrete approximations to partial differential equations, and used as direct 
models for a wide class of natural systems [Wolfram, 1983], [Wolfram, 1984], [Wolfram, 1984a], [Wolfram, 1986], 
[Hastings et at, 2003], [Israeli & Goldenfeld, 2004]. 

A classification and several studies of the cellular automata with k = 2 and r = 1 can be found in [Wolfram, 1983], 
[Wolfram, 1984], [Wolfram, 1984a], [Wolfram, 1986]. 

Representations of the so-called Rules 30, 110 and 124 are shown in tables ITMlTTl 

The top row in each set of three elements gives one of the possible combinations of values for a cell and its immediate 
neighbors. The bottom row then specifies what value the center cell should have on the next step in each of these 
cases. 

Rules 110 and 124 are equivalent under reflection transformations [Wolfram, 1983]. 

Rules 110 and 124 are relevant because they have been proved to be equivalent to Turing machines. So they are 
capable of universal computations [Israeli & Goldenfeld, 2004]. 

On the other hand, Rule 30 has been considered as a model of randomness in nature and has been used as a 
practical pseudorandom number generator [Wolfram, 1986]. 

Rule 30 can be written as a coupled map lattice: 

Y n+1 (i) = [Y n (i-l)+Y n (i)+Y n (i + l)+Y n (i)Y n {i+l)} (mod 2). (22) 

The sequences generated by Rule 30 have been analyzed by a variety of empirical and statistical techniques [Wolfram, 
1986] and the researchers have concluded that they seem completely random. 

Random sequences are obtained from Rule 30 by sampling the values that a particular site attains as a function of 
time. 

An example very frequently used is the apparent "randomness" of the center vertical column in the patterns shown 
in Fig. [7| The evolution of Rule 124 cellular automaton is shown in Fig. |SJ 

In all these works the authors recognize that little has been proved theoretically about Rule 30. However, the center 
vertical sequence has passed all the statistical tests of randomness applied to it. 

If a point that separates the integer part from the fractionary part is placed near the central column as is shown in 
Figures 191101 then the outcomes of the cellular automaton evolution can be transformed into a numerical time series 
{y„}, where the Y n are real numbers written in binary system. 

In the case of Rule 124 this is always a bounded time series where < Y n < 1. 
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TABLE III: Representation of Rule 124 cellular automaton. 
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1101111 
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FIG. 7: Evolution of Rule 30 cellular automaton. 
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FIG. 8: Evolution of Rule 124 cellular automaton. 



The first-return map of a typical Rule 124 time series is shown in Fig. Note that the function Y n+ i = f (Y n ) 
is a fractal. Nevertheless, it is important to notice that despite its fractal structure this is a one-valued first-return 
map. In fact, given any previous value Y n , the next value is always defined by this previous value. We have calculated 
numerically the Lyapunov exponent of this map using different methods of time-series analysis, see e.g. [Wolf et 
al, 1985] and [Kantz & Schreiber, 1997]. In these calculations, we generate the sequence {Y n } using the cellular 
automaton rule. Then we treat the produced sequence as an experimental time-series, and we compute the largest 
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FIG. 9: The outcomes of Rule 30 can be seen as a numerical time series of real numbers written in binary representation. 
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FIG. 10: Binary representation of the time series produced by Rule 124. 



Lyapunov exponent using the mentioned standard methods. In our calculations, the largest Lyapunov exponent is 
approximately A = 0.4. All this leads to the speculation that a dynamical system, that can be mapped to a fractal 
chaotic map of type Y n+ i — f (Y n ), is capable of universal computation. 

The geometrical structure shown in Fig. II II is an invariant and can be used to have a general representation of the 
dynamics for any initial condition. It is independent of time. 

We believe that this kind of representation is more general and useful that the Wolfram's "space-time" calculations 
of several hundreds or thousands steps, because they are by definition limited and misleading. The dynamics that 
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FIG. 11: First-return map constructed using the sequence {Y n } produced with the dynamics of Rule 124 cellular automaton 
as described in the main text, (a) Full first-return map. (b) Zoom of a detail of the first-return map. 



15000 



10000 - 



5000 - 




2 4 6 8 10 12 

n 

FIG. 12: Approximate exponential behavior of {Y n } for Rule 30. 



can be observed in an interval of time of 1,000 steps can be very different in an interval of time taken 1,000,000 steps 
away. 

On the other hand, for Rule 30, the time series {Y n } is an unbounded exponentially increasing function (see Fig. 
H2]l . In fact, {Y n } can be expressed as a map of type 



Y n .\-i — d n Y n , 

where a n always takes non-integer values such that a n > 1. 

From the representation of Rule 30 in Table ^ it is evident that from a number 



Y n = ...&_ 3 &_ 2 6-l.&l&2&3&4-- 



where bi., b-k are zeroes or ones; the number 



Y n+1 = ...b'^b'^.b^b^. 



(23) 

(24) 
(25) 
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FIG. 14: First-return map produced by Eq. I26H . where Y n is the time-series generated by Rule 30 cellular automaton, (a) 
Full map. (b) Detail. 

can be obtained only using a non-integer a n which should be close to 2 (see the actual evolution in Fig. |5J. The 
behavior of a n can be seen in Fig. IT^l 

In fact, a numerical calculation shows that the dynamics of {a n } possesses a quasiperiodic attractor (see Fig. I13f) 
where all the values of a n are close to two possible values: 1.8 and 2.2. 

Thus, Y n is approximately an exponentially increasing function. All we need to produce unpredictable dynamics is 
the application of a non-invertible transformation on Y n . For instance, the function 

X n = Y n (mod 1) (26) 

is much more harder to predict than Rule 124. The first-return map of this dynamics can be observed in Fig. 1141 
Note that the first-return map is two-valued. Given a X n , we always have two possible future values X n +i> 
Notice that if a n = 2, the time-series is predictable as in the Bernoulli shift. 
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n 


Y n 


X n 





0.1450 





1000 





1100 





1200 





1300 


0.1400 





1500 





1600 


0.1700 


0.1800 





1900 


1 


0.6685 





5300 





5830 





6360 





6890 


0.7420 





7950 





8480 


0.9010 


0.9540 





0070 


2 


0.4430 





8090 





0899 





3708 





6517 


0.9326 





2135 





4944 


0.7753 


0.0562 





0371 


3 


0.4482 





2877 





4765 





9652 





4540 


0.9428 





1316 





6203 


0.1091 


0.2979 





1966 


4 


0.4753 





5248 





5253 





1158 





4063 


0.9967 





6972 





2877 


0.5782 


0.5787 





0421 


5 


0.4190 





7815 





7840 





6136 





1532 


0.2827 





6953 





5248 


0.0644 


0.0669 





2233 


6 


0.4204 





1418 





1554 





2519 





8117 


0.4982 





6848 





7813 


0.3411 


0.3545 





1837 


7 


0.6284 





7515 





8239 





3352 





3021 


0.6404 





6296 





1411 


0.8079 


0.8788 





9735 


8 


0.5304 





9827 





3665 





7767 





6010 


0.3939 





3370 





7476 


0.2817 


0.6575 





1598 


9 


0.5112 





2084 





9422 





1164 





1850 


0.0875 





7859 





9621 


0.4930 


0.4846 





8468 



TABLE IV: The columns that correspond to X„ are produced using the map l|27|l with different initial conditions. The variable 
Y n is the average value of the different X n for a given n. 



So it is important that, due to the structure of Rule 30, the resulting a n are always non-integer. This leads to 
unpredictability. 

Other non-invertible transformations can be used to produce unpredictability from Rule 30. 

The operation of sampling the value that a particular site attains as a function of time is a non-invertible trans- 
formation. This can be observed in table [IJ where Rule 30 is represented. So, by sampling the value of the central 
column in the Rule 30 evolution (see Fig. |5J, which is equivalent to a sequence with exponential behavior, we are 
generating a much more unpredictable dynamics than that produced by Rule 124. 

All the studies about this cellular automaton conclude that its dynamics is computationally as sophisticated as any 
physically realizable system can be [Wolfram, 1983], [Wolfram, 1984], [Wolfram, 1984a], [Wolfram, 1986]. 

The authors of these works say that it is computationally irreducible and its outcome can effectively be found only 
by direct simulation or observation. So there should be no general computational shortcuts or finite mathematical 
procedure to investigate its behavior. As a consequence, all the questions concerning infinite time or infinite size 
limits cannot be answered by bounded computations. 

In fact, they cannot be sure if after a very large number of time steps, the dynamics generated by Rule 30 can 
become periodic. 

However, following our results, we can predict that the dynamics produced by sampling the values that a particular 
site attains as a function of time is nonperiodic. 

From this we arrive at a very important conclusion concerning forecasting methods in distributed systems. Although 
the general spatiotemporal dynamics can be deterministic, the local dynamics can seem completely random. 

In other words, chaotic spatiotemporal systems can produce completely random dynamics locally. However, a 
knowledge of system spatiotemporal dynamics can lead to correct predictions, at least in the short term. 

VI. OTHER NON-INVERTIBLE TRANSFORMATIONS 

The operation of calculating the mean value of several time-series is a non-invertible transformation. 
Usually it is assumed that the average value of a quantity will be a more simple dynamics than the dynamics of 
the quantity itself. 

Let us discuss the situation represented in Table IIVI The values of each column are produced using the chaotic 
map 

X n+1 = 5.3X n (modi), (27) 

but with different initial conditions. 

The dynamics in each column is chaotic but predictable. This can be seen in the first-return map shown in Fig. 
H5f aL Given a X n , the next value is uniquely determined. 

Now let us define a new variable Y n as the mean value of the values X n that appear in each row of the Table IIVI 
The result is a time series whose complexity depends on the number of averaged columns (see Fig. H5f bWd)). N is 
the number of averaged column values. 

Note that for N — > oo, the distribution of Y n tends to be Gaussian as expected from the Central Limit Theorem. 
When the chaotic map used for generating the columns is the logistic, the dynamics of Y n is shown in Fig. 1161 
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FIG. 15: First return maps for X n as defined in Eq. 1271 and the variable Y n , which is the average value of the different X, 
as explained in Table |IV| (a) N = 1. (b) N = 2. (c) N = 8. (d) N = 20. 



It is important to remark that different forecasting methods also corroborate that the dynamics of Y n becomes 
unpredictable [Farmer & Sidorowich, 1987], [Sugihara & May, 1990]. 

The average operation can produce complexity also when we have only one time-series. 
Suppose X n is a time-series produced by the chaotic map lfT7f . Now define Yk as: 



N+k 

i 

Y, 



-, N+k 



N 

n— k 

This dynamics will have the same properties as that obtained by the averaging of several different chaotic time-series. 

These results could be relevant to investigations of thermostatistical and economic systems where averaging of 
chaotic quantities is a common practice. 

The "randomness" found in the so-called Bernoulli random variables [Denker & Woyczynski, 1998] is also the result 
of the application of a non-invertible transformation to a chaotic time-series. 

This phenomenon can be seen in the following example: 

Y n = cp (X n ) , (29) 
where X n+ \ = aX n (mod 1), a is a non-integer number, a > 1, and <f> (t) is defined as follows: 

fx, if t > 1/2, , . 

4>{t) = l ' ~ ' ' 30 
w [0, if t < 1/2. 

Note that cj> (t) is a non-invertible function. 

A statistical investigation of the time-series produced by the Eq. I|29f) will show that it has the same properties as 
the Rule 30 central column time-series. 
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FIG. 16: The same as in Fig. 1151 but the generating dynamical system is the logistic map. (a) N = 1. (b) N — 2. (c) N = 3. 
(d) N = 10. 



VII. CONCLUSIONS 



We have shown that there exist dynamical systems that can generate completely unpredictable dynamics in the 
sense that, given any string of generated values, for the next outcome, there is always more than one possible value. 

The mechanism responsible for the generation of randomness, in a very general class of models and physical systems, 
is the presence of non-invertible transformations of time-series that contain nonperiodic (truncated) exponential 
dynamics or chaotic behavior. 

Using a new theoretical framework for randomness, we have investigated some classes of coupled map lattices. We 
have shown that, in some cases, these systems can produce completely unpredictable dynamics. 

Spatiotemporally chaotic systems can produce locally unpredictable dynamics even when the global spatiotemporal 
dynamics is completely deterministic. An example can be an array of coupled Josephson junctions perturbed by a 
chaotic circuit like the Chua's circuit. 

Local measurements of a quantity that characterizes a phenomenon in a complex system (like the climate or the 
seismic events) can generate completely unpredictable time-series. However, the global spatiotemporal data of the 
phenomenon can provide the necessary information for accurate predictions, at least in the short term. 

When dealing with spatiotemporal complexity, a necessary step is an investigation of the full space-time dynamics 
[Chatc, 1995]. Local probes alone are not sufficient for efficient predictions. 

Researchers need both the local and the complete spatiotemporal dynamics to reveal the important features. The 
measurements should be made in an extended zone. The more extended the zone, the better. An experimental setup 
should allow the acquisition of the full space-time information. 

These results are also important in the study of economic systems where non-invertible operations are a common 



15 



practice. 
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